Implicit Deep Learning
نویسندگان
چکیده
Related DatabasesWeb of Science You must be logged in with an active subscription to view this.Article DataHistorySubmitted: 7 August 2020Accepted: 18 June 2021Published online: 16 September 2021Keywordsdeep learning, deep equilibrium models, Perron--Frobenius theory, fixed-point equations, robustness, adversarial attacksAMS Subject Headings690C26, 49M99, 65K10, 62M45, 26B10Publication DataISSN (online): 2577-0187Publisher: Society for Industrial and Applied MathematicsCODEN: sjmdaq
منابع مشابه
Implicit Regularization in Deep Learning
In an attempt to better understand generalization in deep learning, we study several possible explanations. We show that implicit regularization induced by the optimization method is playing a key role in generalization and success of deep learning models. Motivated by this view, we study how different complexity measures can ensure generalization and explain how optimization algorithms can imp...
متن کاملLearning implicit brain MRI manifolds with deep learning
An important task in image processing and neuroimaging is to extract quantitative information from the acquired images in order to make observations about the presence of disease or markers of development in populations. Having a lowdimensional manifold of an image allows for easier statistical comparisons between groups and the synthesis of group representatives. Previous studies have sought t...
متن کاملGeometry of Optimization and Implicit Regularization in Deep Learning
We argue that the optimization plays a crucial role in generalization of deep learning models through implicit regularization. We do this by demonstrating that generalization ability is not controlled by network size but rather by some other implicit control. We then demonstrate how changing the empirical optimization procedure can improve generalization, even if actual optimization quality is ...
متن کاملDeep and Hierarchical Implicit Models
Implicit probabilistic models are a flexible class of models defined by a simulation process for data. They form the basis for theories which encompass our understanding of the physical world. Despite this fundamental nature, the use of implicit models remains limited due to challenges in specifying complex latent structure in them, and in performing inferences in such models with large data se...
متن کاملImplicit learning.
Implicit learning is nonepisodic learning of complex information in an incidental manner, without awareness of what has been learned. Implicit learning experiments use 3 different stimulus structures (visual, sequence, and function) and 3 different dependent measures or response modalities (conceptual fluency, efficiency, and prediction and control). Implicit learning may require a certain mini...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: SIAM journal on mathematics of data science
سال: 2021
ISSN: ['2577-0187']
DOI: https://doi.org/10.1137/20m1358517